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jV^EJCBODS JlF^EEELCTENT TTVrPT.KMFNTATION OF 
TRELLIS BASED SPECTR.AX SHAPING WITH LOOKAHEAD 



Field of the Invention 



This invention relates to systems an methods 
systems, and is particularly applicable to data 



^jT spectral shaping of signals in corrmmnications 
communication equipment like a modem. 



Background of the Invention 

In digital communications it is sometimes desirable to avoid transnaission at certain frequencies 
in the transmission spectrum. It is usually necessary to do so in order to avoid imdesirable 
distortion which might result if communications signals use certain frequency components. The 
presence of such distortion can lead to unnecessary performance degradation. 

To avoid transmission at the undesirable frequencies in the spectrum it is necessary to shape the 
transmission spectrum of the transmitted signals accordingly. The principles of spectral shaping 
are conveniently described, for example, in United States patent 5.818,879, entitled "Device, 
System and Method for Spectrally Shaping Transmitted Data Signals". Previously proposed 
schemes for spectral shaping achieve the desired resuh by the use of redundancy. One such 
scheme is the trellis based spectral shaping which has been proposed for the V.90 standard to 
be ratified by the ITU-T International Telecommunication Union: 'A digital modem and 
analogue modem pair for use on the pubhc switched telephone network (PSTN) at data 
signalling rates of up to 56 000 bit/s downstream and up to 33 600 bit/s upstream' nU-T 
recommendation V.90, September 1998, Geneva, Switzerland. This scheme uses a 
convolutional code with two states and provides significant gain. 



Summary of the Invention 



A straightforward M-ary tree implementation conventionally requires a start-up phase and a 
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steady-state phase, increasing the complexity. In one aspect of the present invendon pre- 
deteimined state transitioiis according to a valid trellis path arc assumed during the start-up 
phase. The performance penalty for small look-ahead depth is insignificant and deviation if 
present is for a very short duration. 



In accordance with the present inventioi-, there is provided a method of coding dieital 
data for transmission according to a trellis coding; system having a predetermined number of (N) 
states and a predetermined number of (M) stat^^^isitions firom each state, wherera the data is 
arranged in a series of frames, a state is associated with each frame to detennine a coding 
strategy for the frame, and a look-ahead deptl. (D) representing a number of data frames is 
selected, characterised by the step of: 

assigning an initial state for a first frame of the series of data frames, and assigning 
states for the subsequent data frames in the series of data frames up to the look-ahead depth 
according to a predetemained valid trellis path, the method fiirther including: 

sequentially fetching subsequent data frames in the series and detennining respective 
states therefor based on a path metric for state transitions computed over the number offices 
represented by the look-ahead depth; and 

coding the data frames for transmission according to the coding strategies corresponding 
to the states assigned or detemiined for the frames, wherein the series of data frames are coded 
for a shaped spectrum upon transmission thereof. 



The present invention also provides a data encoder for generating spectrally shaped coded data 
according to a trellis coding system, wherein the data is arranged in a series of data frames from 
a data source and a trelhs state is associate ^ith each data frame such that a coding scheme for 
each frame may be determined on the basis of transitions of states for fi^es over a selected 
look-ahead depth (D), comprising: 

a buffer memory coupled to the data source for buffering data frames in the series of 
data frames by the selected look-ahead depth (D); 

a metric computation and trellis extension engine coupled to sequentially receive said 
data frames from the data source and determine node information in a plurality of nodes for each 
said frame representing possible states, state transitions from a preceding frame and path metrics 
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for the state transitions; 

a cuirent state storage coupled to the metric computation and trellis extension engine for 
storing the state of a current frame in the series of data frames; 

a node memory coupled to the metric computation and trellis extension engine for 
storing said node information for nodes of a frame succeeding the current fi'ame by the look- 
ahead depth; 

a coding scheme memory for storing a correlation between stare transitions and 
respective coding schemes; and 

a processing circuit coupled to the coding scheme memory and metric computation and 
trellis extension engine for applying a selected coding scheme to a data frame to generate 
spectrally shaped coded data; 

wherein said metric computation and trellis extension engine determines the selected 
coding scheme for the current frame according tO| 
a node for the frame succeeding the citrrent frami 
the basis of the path metric for the node, characteHsed by: 

the metric computation and trellis extension engine assigning an initial state for a first 
frame of the series of data frames, and assigning states for the subsequent data fr-ames in the 
series of data frames up to the look-ahead depth according to a predetermined valid trellis path. 



he state stored in the current state storage and 
the look-ahead depth which is selected on 



In the preferred for of the present invention, 
The trellis shaper chooses a predeterm: 
irrespective of the criterion for selection o 
selection criterion to select the state transitiAn 



:he start-up phase and the steady state arc unified. 

iid valid trellis path during the start-up phase 
^e'sub-trec. Once in the steady state, it uses the 



The trellis shaping fanction of the preferred embod: ment is implemented with a linear structure 
that requires memory for only the nodes at level D of the binary tree. In the steady state phase, 
for each input spectral shaper frame X,>d the prefrf 

associated with each of the paths. The nodST^levcl Eh-1 which satisfies the selection 
criterion is then chosen as the best path. The state transition from the current root node and the 
subsequent root node is determined by the cmrrcnt trellis state and the best path. 



The preferred implementation provides a signifi<||pt reduction in computation and memory 
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({I requirements, and the performance penaJi^a result is insignifi^^ 
Brief Descri ption nf rhe Drawing'; 



5 The invention is described in greater detail hereinbelow, by way of example only, through 
description of preferred embodiments and with reference to the accompanying drawings, 
wherein: 

Figure 1 is an exemplary state diagram of a two state trellis spectral shaping code; 
^ Figure 2 illustrates a steady state binary tree diagram for a two state trellis based 

1 0 spectral shaping code with look- ahead depth of 3; 
I Figure 3 is an exemplary diagram of design of a trellis based spectral shaper; and 

g Figure 4 is a block diagram of an encoder for use in a modem or the like in which 

ri embodmients of the present invention may be implemented. 

- - 3 

I Petaiied PrTription of the Prfifenreri Fn^^ ^H lTp on t -i 

I By way of background, Figure 4 is a block diagram which illustrates an overview of an encoder 

■r^ for use m a digital modem or the like, and represents one data frame. In the following 

descnption, data frames in the digital modem have a six-^bol structure. Each symbol position 
20 within the data frame is called a data frame interval and is indicated by a cyclic time index, i = 

0. .... 5. Frame synchronisation between the digital modem transmitter and an analogue modem 

receiver is established during training procedures. 

Mapping parameters for the encoder, established during training or rate renegotiation 

25 procedures, are: 

0) sbc PCM code sets, one for each data frame interval 0 to 5. where data frame interval i 
has Mj members; 

(ii) K, the number of modulus encoder input data bits per data frame- 

(Hi) S the number of PCM code sign bits per data frame used as redundancy for spectral 

shaping; and 

(iv) S, the number of input data bits for the spectral shaping scheme, where S ^ S, = 6. defme 
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the six PCM code sign bits according to a sign assignment procedure. 



The encoder 10 illustrated in Figure 4 includes a bit parser 12 which receives D (equal to S + K) 
serial input data bits do to do.,, and is coupled to a modulus encoder 14 and a spectral shaper 22. 
5 The input data bits do to dj^, (where c^, is first in time) are parsed into S sign input bits and K 
modulus encoder bits. The data bits do to dj., form So to s^.,, and ds to d^., form bo to bj,.,. 

K bits enter the modulus encoder 14. Additionally, there are six independent mapping moduli. 
Mo to IV^ , which are the number of members in the PCM code sets defined for data fi-ame 
10 interval 0 to data firame interval 5, respectively. The modulus encoder 14 converts K bits into 
six numbers, Ko to K,, using the following algorithm which is specified in the aforementioned 
proposed standard: 



15 



20 



3. 



Represent the incoming K bits as an integer, R^; 

Ro = bo b;2' + b2-2= + ... -H bj,.,-2^-> 

Divide Ro by Mo. The remainder of this division gives Kg, the quotient becomes R, for 
use in the calculation for the next data fi^e interval. Continue for the remaining give 
data fi-ame intervals. This gives K^, to as: 

K; = R. modulo M^, where 0 :£ K. < M^; Rj^, = (R^ - Kj) / Mj 

The numbers Ko, .... Kj are the output of the modulus encoder, where Ko corresponds 
to data frame interval 0 and Kj corresponds to data fi-ame interval 5. 



25 The modulus encoder 14 is coupled to six independent mappers 16 associated with the six data 
frame intervals. Each mapper is a tabulation of H PCM codes (corresponding to positive 
analogue values) that make up the constellation points of data fi-om inteival i. The PCM codes 
to be used in each data frame interval are specified by the analogue modem during training 
procedures. Each mapper 16 receives the quantities from the modulus encoder 1 4 and forms 

30 Ucode values V; by choosing the constellation point labelled by K^. 
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SpearaJ shaping carried out according to the aforementioned standard by the spectral shaper 22 
only affects the sign bits of transmitted PCM symbols. In every data frame of 6 symbol intervals, 
S, sign bits are used as redundancy for spectral shaping whUe the remaining S sign bits carry user 
information. The redundancy, S, is specified by the analogue modem during training procedures 
5 and can be 0. 1. 2. or 3. When = 0, spectral shaping is disabled. 

The spectral shaper operates on a spectral shaper frame basis. For the cases S, = 2 and = 3, 
there are multiple shaper frames per six-symbol data frame. Spectral shaper operation for each 
shaper frame ^vithin a data frame (herein referred to as a shaping frame j) is identical except that 
1 0 they affect different data frame PCM sign bits. In particular, the spectral shaper modifies initial 
sign bits to corresponding PCM code sign bits ^...) without violating the constraint 
described below, so as to optimize a spectral metric. 

The constraint of the spectral shaper can be described by way of a 2-state treUis diagram, such 
1 5 as that shown in Figure 1 . In a given spectral shaping frame i, the spectral shaper modifies the 
initial sign sequence according to one of the following four sign inversion rules: 
Rule A: Do nothing; 

Rule B: mvert all sign bits in the spectral shaping frame; 
Rule C: Invert odd-numbered sign bits in the spectral shaping frame; 
20 Rule D: Invert even-numbered sign bits in the spearal shaping frame. 

The trellis diagram describes the sequence of sign inversion rules that are allowable. For 
example, when the spectral shaper is in state S, at the beginning of frame i. only ivies A and B 
are allowable in that frame. The current state together with the sign inversion rule selected for 
25 the frame determine the next state according to the trellis diagram. 

A look-ahead depth parameter D may be an integer between 0 and 3. for example, selected by 
the analogue receiving modem during training procedures. Look-ahead depths of 0 and 1 are 
mandatory in the digital modem according to the aforementioned standard, whereas look-ahead 
30 depths of 2 and 3 are optional. To select the sign inversion mle for the i* spectral shaping frame 
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the spectral shaper uses the PCM symbol magnitudes produced by the mapper 16 for spectral 
shaping frames i, i+1, i+D. The spectral metric that would result from each of the allowable 
sequences of sign inversion rules for frames i through i+D, starring from the current state, is then 
computed. Based on those computations, the spectral shaper then selects the sign inversion rule 
5 for frame i that minimizes the spectral metric, which is defined as the sum of the squares of the 
RFS up to and including the final symbol of spectral shaping frame i+D. The selection thus 
determines the new state of the system. The spectral shaper then sets the PCM code signs for 
shaping frame according to the selected sign inversion rule. 

10 A trellis based spectral shaping scheme in an embodiment of the present invention uses a 
trellis code with N states and M state transitions from each state (M, N posidve integers). 
Performance gain is achieved by using larger redundancy and increasing the look-ahead 
depth. TreUis based spectral shaping is usually implemented using M-ary trees. The 
information to be spectraUy shaped is assumed to be framed and is hereafter referred to as the 
15 spectral shaper frame. The size of the spectral shaper frame varies to accommodate 
additionaUy redundancy bits. The spectral frame size and the look-ahead depth D being 
variables, the complexity of implementation of the spectral shaping technique increases. An 
implementation scheme which deals with all the cases unifonnly is desired to make it 
computationally efficiem. The memory requirements for the scheme should also be kept as 
20 small as possible. 

The treUis state diagram for the two state trellis is as shown in Figure 1, having two states So 
and S.. The state transidons are labelled a, b, c and d and associated with state transition! 
So->So, So->S„ S, -> So and S, -> S„ respectively. The state transition in a treUis 

IS depends on the currem state and a selection criteria for the state transition. Only certain 
sequence of state-transitions are allowed, and tiiey constimte a valid patii. These valid paths 
are defined by the trellis code. The selection of the state transition for a spectral shaper frame 

X; and using a look-ahead deptii of D requires specu^ shaper frames }^ . , 

Therefore, on stan-up die binary tree should be filled up to level D to commence sle 

0 transition assignment. This phase is called tiie stan-up phase. The first state in the trellis is 
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pre-defmed and the first state transition thus emanates from that predetermined state. The 
stan-up phase lasts for D spectral shaper frames, and thereafter the system enters into a steady 
state phase. The state transition selected is one of the two possible state transitions from the 
current state and the criterion for selection is the metric computed for spectral shaper frame 

^ ^i+D- 

For the case of N=2, and M=2, a conplete binary tree T can be constructed with the root 
node being the current state S, The maximum level of the tree is D + 1 where D is the look- 
ahead depth. There will be a total of 2^-' paths and 2'>*^-l nodes in the binary tree. With 
1 0 every input spectral shaper frame Xi^^, a new root node is selected and the treiUs is extended 
at level D. Each node at level D has two sute transitions emanating from it resulting in a 
total of p=2^-' nodes at level D+1. The merries corresponding to each of the p state 
transitions are computed. Hiese are the branch metrics. The patii metrics for the p paths are 
updated by adding the branch metrics to the accumulated path metrics of nodes at level D. 
15 The node at level D+ 1 which gives the lowest path metric according to a criterion is selected 
as the best node. The tree is then traversed backwards from selected node to reach the root 
node. The state transition assignment for tiie spectral shaper frame Xj is selected to be either 
the left or right subtree of the root node R, according to whether tiie selected node is a left of 
the left or right subtree of tiiis root. The tree is tiien updated with the root R,,, being the 
20 node connected to R,. The leaves of the new tree so formed are at level D+1. This procedure 
is continued for every new input spectral shaper frame. The memory requirements for this 
implementation is 0(2°*^ - 1). 

The procedure can be generalised for any trellis code with N states and M state transitions 
25 from each state. The tree thus formed will be M-ary and complete. The memory 
requirements for a lookahead depth D spectral shaper code in this case will be OcM^UlL) 

Figure 3 is a block diagram of processing apparanis for implementing the spectral shaping 
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scheme of the preferred embodiment of the present invention. The processing apparams 9 
receives spectral frames X; as input, and outputs spectrally shaped output frames. The input 
spectral frames are provided to a delay buffer 1, which delays the input spectral frames by 
the look-ahead depth D before passing them to a state transition application circuit 2 which 
5 applies the spectral shaping and outputs the spectrally shaped output frames. The spectral 
shaping which is applied by the state transition circuit 2 is determined by spectral shaping 
processing circuitry on the basis of the input spectral frames over the look-ahead depth. The 
spectral shaping processing circuitry includes a metric computation and trellis extension 
engine 3, a node memory RAM 3, a currem root node state storage 6, a state transition 
10 information ROM 7, and a state transition selector 5. The operation of the processing 
apparatus 9 is described in greater detail hereinbelow. 

The input spectral frame buffer 1 is zeroed at reset. The decision on the state assignment for 
the first spectral frame is taken only after D spectral frames are input to the delay buffer 1. 
15 However all the operations in the preferred embodiment of the present invention are 
performed as in steady staK. The metric computation and treUis extension engine 4 performs 
operation as in steady state during the stan-up phase (e.g. during the first D spectral frames). 
This is achieved by assuming that a specific valid trellis path is taken irrespective of the 
metric computations. This is necessary because the first state in the trellis is predetermined. 
20 This predetermined path is used for updating of the next root node state 6 and subsequent 
updating of the nodes table in node RAM 3. This procedure is carried on till D-1 frames are 
input to the n-ellis shaper. The procedure employed during the stan-up phase is similar in 
every respect to that of the steady-state phase except that the root node state 6 is 
predetermined in the stan-up phase. 

25 

The D-' input spectral frame is stored in the input spectral frame buffer 1. The same frame 
is input to the metric computauon and trellis extension engine 4. The nodes at level D are 
extended with all possible state transitions emanating from them. The state transition 
information is read from the state transition infomiation ROM 7. The metrics for all nodes 
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are computed and accumulated to get the path metrics for all possible paths starting from the 
root node. The path metrics so computed for all the paths emanating from nodes at level D 
are compared and the one which satisfies the path selection criterion is chosen as the best node 
at level D+1. The subtree which contains the best node is then chosen and the node RAM 
5 3 is updated with the nodes at level D in the subtree. The current root node state 6 of the 
trellis is also updated. 



The current root node state 6 and the best node at level D + 1 computed by the metric 
computation and trelhs extension engine 4 is used to select the state transition between the 
10 current root node and the next current root node. The state transition selector 5 receives the 
state aransition information from ROM 7. The state transition information is then applied to 
the D* previous input spectral frame by the state transition ^pUcarion circuit 2. The resultant 
frame is the spectrally shaped frame. 

15 As mentioned above, the metric computation and trelUs extension engine 4 computes the 
branch metric for all possible state transitions emanating from nodes at level D. The path 
metrics starting from die root nodes to all the nodes at level D + 1 are accumulated. There 
IS sufficient scratch memory in the metric computation and trellis extension engine 4 and node 
RAM 3 to hold the temporao' node memory for level D+1. After searching for the best path 

20 which satisfies the preferred criterion, the sub-tree which contains the best node at level D+ 1 
IS stored in node memory 4. The node memory 4 is a linear array of all nodes at level D 
For a two state trellis code with two state transitions from each node. Figure 2 illustrates the 
steady state tree smicmre with level D+1 for a look-ahead depth of D=2. The allocation for 
the nodes in node memory 4 is Nl. N2, N3 N8 and in that order. This stmcture is very 

25 efficient because when the best node is computed, it is very easy to locate the subtree (left or 
nght for the binary tree case) to which the best node is connected to. This provides the state 
transition and the root node for the next iteration. 

An example of a trellis based spectral shaping code is illustrated in Figure 1 for the case of 
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M=2. and N=2, and Figure 2 is the corresponding steady state representation of the binary 
tree with look-ahead depth of D=2. During the start-up phase, the trellis state is 
predetermined to be state So, for example. The first D-1 spectral shaper frames X„ X„ 

are stored in the input frame buffer 1. Each frame is fed to the meuic computation and 
5 trellis extension engine 4, where the branch and path metrics for all the paths are computed 
as if in the steady state phase. The node memory 3 is updated such that a fixed trellis path 
starring from state So is followed irrespective of the path metrics and the selection criterion. 
This is done because complete node mformation for the whole path is not available until the 
specu-al shaper frame is provided to the metric computation and trellis extension engine 
10 4. The current root node state is also predetermined, according to the selected valid trellis 
path starting from the predetermined initial state Sq. 

When the spectral shaper frame X^ is provided to the ii^ut buffer 1 and the metric 
computation and trellis extension engine 4, the steady state phase is reached. The trelUs is 
15 thenextendedtolevelD-hl. branch metrics for all states emanating from nodes at level 
D are computed and accumulated with the previous path metrics to obtain the total path 
tnetrics. For tiie M=2. N=2 case, for any lookahead depth D. 1, the state transitions at 

level D+1 will be the state transition a, b. c, d a, b, c, d, and it is not necessary to store 

this information in state transition information ROM 7. A total of 2^^' path metrics are 
20 computedforeveiynewinputatlevelD-Hl. The paths are numbered 1. 2, 3, 4 ....2^*» and 
are stored linearly in memory, tiie path which satisfies the spectral shaping criterion will be 
selected as the best path, and the selected path number decides whether the best path is in the 
left or right sub-tree. If best path number is less than or equal to 2". then the left subtree is 
selected, else the right subtree is selected. Knowing tiie current state and the best node, the 
25 current root node state 6 is updated. The metric computation and trellis extension engine 4 
updates the node memory 3 witii the selected subtree. The state transition for the spectral 
frame is loaded from state transition ROM 7 using the current root node state. It is then 
applied to the Dth previous frame to produce the spectrally shaped frame by the state 
transition application circuit 2. The above described procedure is followed for every 
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successive spectral shaper frame. 

The preferred embodiment of the present invention simplifies the design of the trellis based 
spectral shaper for variable look-ahead depth and variable spectral frame size. Treating the 
5 stan-up phase and the steady phase unifonnly reduces complexity. It also allows simple 
linear stmctures for storage of node information. This results in the effect of reducing design 
complexity of the trellis based spectral shaper by reducing computational and Lmory 
requirements. 

10 As will be appreciated by those skilled in the art from the foregoing description, operating 
directly in the steady state allows usage of a structure which is not a M-ary tree. The RAM 
requirements for storing the node information in node memory 3 is C?(A/^ . The M-ary tree 
traversing is also circumvented by using the state of the root node for determining the state 
transition association with the current spectral shaper frame X, This enables a significant 

15 reducdon in memory and computational requirements. 

The foregoing detailed description of embodiments of the present invention has been 
presented by way of example only, and is not intended to be considered limiting to the 
invention as defined in the appended claims. 
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